Introduction to the Ontology Alignment Evaluation 2005

The increasing number of methods available for schema matching/ontology integration suggests the need to establish a consensus for evaluation of these methods. The Ontology Alignment Evaluation Initiative1 is now a coordinated international initiative that has been set up for organising evaluation of ontology matching algorithms. After the two events organized in 2004 (namely, the Information Interpretation and Integration Conference (I3CON) and the EON Ontology Alignment Contest [4]), this year one unique evaluation campaign is organised. Its outcome is presented at the Workshop on Integrating Ontologies held in conjunction with K-CAP 2005 at Banff (Canada) on October 2, 2005. Since last year, we have set up a web site, improved the software on which the tests can be evaluated and set up some precise guidelines for running these tests. We have taken into account last year’s remarks by (1) adding more coverage to the benchmarck suite and (2) elaborating two real world test cases (as well as addressing other technical comments). This paper serves as a presentation to the 2005 evaluation campaign and introduction to the results provided in the following papers.